
RECEIVED 

v_ JUL 2 0 2004 

1 Technology Center 2600 

f Reference: ESI-123-B PATENT 

SUBSTITUTE SPECIFICATION 
DIRECTIONAL LIGHTING AND METHOD TO DISTINGUISH THREE 
DIMENSIONAL INFORMATION 



CO-PENDING APPLICATION 
[OOOO. 1 ] This application claims the benefit of the priority date of co- 
pending Provisional Application Serial No. 60/200,776, filed April 28, 2000 in 
the names of Kenneth Chapman and Sam Duhan, the entire contents of 
which is incorporated herein by reference. 

FIELD OF THE INVENTION 
[0001 ] The present invention relates to inspecting the surface of surface- 

mounted components for three-dimensional data. 

BACKGROUND OF THE INVENTION 
[0002] Surface-mounted components are inspected at many stages of 

their manufacture and for many different flaws. One type of component is a 
surface-mounted multi-layered ceramic capacitor (MLCC) component. As they 
are manufactured and used these components must be smooth, or planar. 
These components are typically made from ceramic and thus can be 
comparatively easily scratched, chipped or broken. These types of defects are 
generally referred to as three-dimensional, or 3-D defects. Ceramic 
components may also include other types of 3-D defects such as holes. 
[0003] A core problem with inspecting ceramic components for 3-D 

defects is that it is difficult to distinguish between an unacceptable 3-D defect 
and an acceptable stain. To solve this problem the prior art developed highly 
sophisticated vision algorithms. Because a certain amount of imperfection can 
be tolerated, the algorithms must also qualify the 3-D defects as to whether they 
compel the rejection of a component or whether they can be tolerated. These 
algorithms did not operate as quickly as many manufacturers would have liked 
because of the amount of computer processor time they required. Further, the 



prior art algorithms required that the components move at a comparatively slow 
rate so that the inspection could be carried out. The prior art 
techniques often resulted in an artificially high rejection rate as vision 
algorithms could not distinguish between discoloratidns and 3-D defects. 
[0004] Therefore a need has arisen to provide an inspection system that 

can easily distinguish 3-D information from 2-D information at a comparatively 
faster rate without the use of excessive computational power. 

SUMMARY OF THE INVENTION 
[0005] The present invention provides a method and apparatus for cost 

effectively evaluating three-dimensional features on a substrate. 
[0006] One aspect of the method of the present invention provides for 

evaluating three-dimensional features on a substrate including illuminating the 
substrate from a first angle and capturing a first image of the substrate. The 
first image is made up of a plurality of pixels, the pixels having an address and 
a value. The pixel address corresponds to a location on the substrate. The 
method also provides for illuminating the substrate from a second angle and 
capturing a second image of the substrate. The second image is also made up 
of a plurality of pixels where the pixels are addressed in the same manner as 
the pixels in the first image. Each pixel in the second image also has a value. 
The pixel values from the first image are subtracted from the pixel values in the 
second image on a pixel address by pixel address basis to create a third image. 
The third image is processed to determine the quantity of pixels characteristic 
of three-dimensional features therein. The substrate is rejected if the quantity 
pixels characteristic of three-dimensional features exceeds a predetermined 
value. 

[0007] A further aspect of the method of the present invention involves 

applying a threshold to the third image such that the pixel values are either 
zero or above the threshold.. The non-zero pixel values are characteristic of 
three-dimensional features on the substrate. The pixel addresses 
corresponding to the non-zero pixel values may then be recorded. The method 
may provide for creation of a fourth image by selecting the minimum pixel value 
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between the first and second images on a pixel address by pixel address basis. 
Then the fourth image may be processed at the recorded pixel addresses to 
evaluate the pixel values at the recorded locations. The substrate may be 
rejected if the evaluation of the pixel values is outside defined tolerances. 
[0008] Another aspect of the present invention provides an apparatus 

for evaluating three-dimensional features on a surface of a substrate. The 
apparatus includes a first light source positioned at a low angle relative to the 
substrate such that when the first light source illuminates the surface of the 
substrate, three-dimensional features on the surface of the substrate, having 
a first orientation, produce glints. A second light source is provided where the 
second light source is positioned opposite from the first light source such that 
when the second light source illuminates the surface of the substrate, three- 
dimensional features on the surface of the substrate, having a second 
orientation, produce glints. A camera is positioned perpendicularly above the 
substrate and the camera captures images of the substrate. The images are 
made up of a plurality of pixels, the pixels including an address characteristic 
of a location on the surface of the substrate and a value. The camera captures 
a first image of the substrate when the substrate is illuminated by the first light 
source, and the camera captures a second image of the substrate when the 
substrate is illuminated by the second light source. A processor is provided 
where the processor is configured to calculate the difference between the pixel 
values in the first image and the pixel values in the second image on a pixel 
address-by-pixel address basis to form a third image. The processor is further 
configured to count the number of pixel addresses in the third image that are 
characteristic of three-dimensional features. 

[0009] According to a further aspect of the apparatus of the present 

invention, the processor applies a threshold to the third image such that the 
pixel values in the third image are either zero or above the threshold. The 
pixel values that exceed the threshold are characteristic of three-dimensional 
features. The processor is operative in counting the non-zero values within the 



third image and indicating that the substrate is rejected if the number of non- 
zero pixel values exceeds a predetermined value. 

[0010] According to a further aspect of the apparatus of the present 

invention the processor records the pixel addresses of those pixel values in the 
in the third image that exceed the threshold. The processor then selects the 
minimum pixel value between the first and second images on a pixel address 
basis to create a fourth image. The processor is configured to evaluate the 
pixel values in the fourth image at and around the recorded locations. The 
processor rejects the substrate if the evaluation of the pixel values at and 
around the recorded addresses fall outside defined tolerances. 
[001 1 ] Other applications of the present invention will become apparent 

to those skilled in the art when the following description of the best mode 
contemplated for practicing the invention is read in conjunction with the 
accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0012] The description herein makes reference to the accompanying 

drawings wherein like reference numerals refer to like parts throughout the 
several views and wherein: 

FIGURE 1 is a schematic representation of the vision system of 
the present invention; 

FIGURE 2 illustrates the present invention using a first light 

source; 

FIGURE 2A is an image captured using the first light source; 
FIGURE 3 illustrates the present invention using a second light 

source; 

FIGURE 3A is an image captured using the second light source; 

FIGURE 4 is a third image created by taking the absolute value 
between FIGURES 2A and 3A; 

FIGURE 5 is a fourth image created by taking the minimum value 
between FIGURES 2A and 3A; and 
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FIGURE 6 is a flow chart illustrating the process of the present 

invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 
[0013] The present invention uses directional lighting to highlight 3-D 

regions in an image. In particular, the present invention captures two images 
of a substrate, typically made from ceramic, with low-angled lighting positioned 
at opposite ends of the component. The images are subtracted from one 
another such that the 3-D regions on the component are identified. The 3-D 
regions are found in the subtracted image to further evaluate the 3-D regions. 
[0014] Additionally, the system may record the locations at which the 

recorded locations may be used to process a minimum image when the 
minimum image is made up of the minimum values between the two captured 
images. The substrate may be rejected based on the salvation of the minimum 
image. 

[001 5] With reference to the figures and in particular to FIGURE 1 , there 

is shown a vision system 10. Substrate 22 is typically ceramic, but it is 
understood that the present invention is not limited to the inspection of any 
particular substrate. Typically vision systems inspect components fairly 
comprehensively. That is, as described in the background of the invention, they 
inspect components for overall size, etc. Such inspection may also include 
measurement of the length of the termination band. The present invention is 
directed to 3-D features or defects including but not limited to scratches and 
cracks. 

[0016] The vision system 10 includes a camera 12 positioned 

perpendicularly above a substrate 22. Camera 1 2 preferably captures an eight- 
bit gray-scale image having 256 different shades of gray, valued between 0 and 
255. The images output from camera 12 are made up of a pixels. Each pixel 
has an address and a value. The address of the pixel is characteristic of a 
location on the surface of the substrate. The value of a pixel is the gray-scale 
value. In the preferred embodiment a CCD camera is used having an array of 



640 x 480 pixels which is available for purchase from Opteon. It is recognized 
that any other type of digital camera may be used, such as a CMOS sensor. 
Data from camera 12, which represents an image of the substrate 22, is output 
to an image processor 14. Image processor 14 processes the data as 
described below to accept or reject the component based on evaluation of pixel 
data characteristic of the 3-D factors. The image processor 14 preferably is a 
personal computer (PC). 

[0017] In the first preferred embodiment, two light sources 16 and 18 are 

positioned at opposite ends of substrate 22. In the preferred embodiment, light 
sources 16 and 1 8 are LED illuminators that can be controlled quickly such that 
each one illuminates sequentially. LED illumination is preferred because it is 
a rapid illumination technique, but it is not monochromatic such that it creates 
interference effects. It is understood that other type of quick illumination could 
be used such as strobe illumination. 

[0018] With reference to FIGURES 2 and 3, as well at the flow chart 

illustrated at FIGURE 6 vision system 10 captures two distinct images of 
substrate 22, at 40 and 42. Each image is captured by camera 12. As shown 
in FIGURES 2 and 2A the first image, or IMAGE 1 is captured using illumination 
from light source 16. Similarly as shown in FIGURES 3 and 3A and the second 
image, or IMAGE 2 is captured using illumination from light source 18. As 
shown in FIGURES 1 and 2, when IMAGE 1 is captured with light source 16, 
a 3-D feature 20 will produce a glint 24 on the side of the feature 20 distal from 
light source 16, and the feature 20 will produce a shadow 26 on the side of 
defect 20 proximate to light 16. As captured by camera 12 and illustrated by 
FIGURE 2A, glint 24 will result in locally higher gray-scale values, and shadow 
26 will result in locally lower gray-scale values. In the typical case, glint 24 will 
result in enough light to result in a gray-scale value of 255. IMAGE 1, as 
captured by camera 12 includes a plurality of pixels where the pixels have an 
address and a value. The address is characteristic of a location on the 
substrate. 
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[0019] As illustrated in FIGURE 3 and 3A IMAGE 2 is captured using 

illumination from light source 18. As captured with light source 18, a glint 28 
appears where the shadow 26 had been in IMAGE 1 and a shadow 30 appears 
where the glint 24 had been. FIGURE 3A represents IMAGE 2. IMAGE 2 is 
made up of the same number of pixels as IMAGE 1 and includes the same 
address scheme although IMAGE 2 includes different pixel values compared 
to IMAGE 1 . 

[0020] As shown in FIGURES 1 , 2 and 3, light sources 16 and 18 are 

positioned at a low angle relative to substrate 22. It is understood by those of 
ordinary skill in the art that a smaller angle from the horizon will yield more 3-D 
data (as described below). However, as the angle from the horizon decreases 
the resulting images will be dimmer. It is also understood that as the light 
source is positioned at a higher angle from the horizon the image is brighter but 
the amount of 3-D data (as described below) decreases. It has been 
discovered that the preferred angle is between about ten degrees and fifteen 
degrees from the horizon. Positioning the light sources at this angle results in 
the optimum creation of glints and shadows for a wide range of 3-D defects. 
[0021] With reference to FIGURE 6 there is shown a flow chart 

describing, in its majority, the operation of image processor 14. As shown, 
IMAGE 1 and IMAGE 2 are captured at 40 and 42. As shown at 44 the pixel 
values from IMAGE 1 are subtracted from the pixel values from IMAGE 2 on a 
pixel address-by-pixel address basis. Thus, for 3-D data, glints are subtracted 
from shadows and shadows are subtracted from glints, each resulting in a 
comparatively high or bright value. For 2-D data the pixel values for any given 
pixel location in either of IMAGE 1 or IMAGE 2 will be the same, not close to the 
same. Thus, subtracting IMAGE 1 from IMAGE 2 for 2-D data will result in 
values of zero, or not much greater. IMAGE 3 is created as the absolute value 
between the difference between IMAGE 1 and IMAGE 2. FIGURE 4 illustrates 
the absolute value between the difference between IMAGE 1 and IMAGE 2 
where the background is black, and both glints are illustrated. 
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[0022] As shown at 46, image processor 14 applies a threshold to IMAGE 

3 to eliminate artifacts. Thresholding an image is well known in the image 
processing field. Application of a threshold will yield pixel values that are zero 
or above the threshold. After a threshold has been applied to IMAGE 3, the 
image processor 14 can determine the magnitude of 3-D data by simply 
counting the number of pixel locations that have a non-zero value. If the 
number of pixel locations having a non-zero value exceeds another threshold 
at 48, the part is rejected as having an excess of 3-D data at 50. For purposes 
of the comparison at 48 the quality, or shape, of the 3-D defects is not 
evaluated. The threshold at 48 is based on the simple premise that if there is 
an excess of 3-D data at least some of that data must represent fatal defects. 
Preferably this threshold is set by a user when the system is initially installed 
based on the user's individual requirements. 

[0023] If the amount of 3-D data is not so great as to warrant rejecting the 

component at 48 and 50, the system records the addresses at which the non- 
zero pixel values are located at 52. IMAGE 4 is created at 54. IMAGE 4 is 
created by comparing IMAGE 1 to IMAGE 2 and selecting the minimum pixel 
value for any given pixel address. This results in selecting the values 
representing the shadows as found in 3-D data from IMAGES 1 and 2. IMAGE 

4 is illustrated at FIGURE 5. 

[0024] At 56, the image processor 14 processes IMAGE 4 at and around 

those locations containing 3-D data as recorded at 52, i.e., at and around the 
pixel addresses recorded at 52. Because the locations of the 3-D features are 
known based on recordation at 58, the image processor 14 can use standard 
morphology as recognized by those of skill in the art to access the shape and 
size of the 3-D feature. Such well-known techniques include gray-scale 
morphology. If the size and shape of the defect is acceptable, as defined by 
user set tolerances, the part is accepted relative to 3-D defects at 62; if the size 
and shape is unacceptable then the component is discarded at 60. 
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[0025] Morphology is used to eliminate any very small regions, leaving 

only those areas that are of a size large enough to be considered a defect. If 
the region is a 3-D region and it is large enough then it is a defect even if the 
total 3-D pixel count is not large enough to trigger rejection at 50. This may be 
the case where the morphology determines that the 3-D data is highly 
concentrated in a single area on the component. The morphology examines 
both the size of any individual 3-D defect (defined as a substantially contiguous 
area of 3-D data) as well as their concentration within a specific area. The 
basis for rejecting or accepting a component after determination of the size of 
the 3-D defect will depend on the specific component inspected as recognized 
by those of ordinary skill in the art. 

[0026] The present invention allows components which include 3-D data 

below the initial threshold to be accepted as long as the contiguous regions of 
3-D data are individually small. 

[0027] While the invention has been described in connection with what 

is presently considered to be the most practical and preferred embodiment, it 
is to be understood that the invention is not to be limited to the disclosed 
embodiments but, on the contrary, is intended to cover various modifications 
and equivalent arrangements included within the spirit and scope of the 
appended claims, which scope is to be accorded the broadest interpretation so 
as to encompass all such modifications and equivalent structures as is 
permitted under the law. 



